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(54) A method and an arrangement for objective assessment of video quality 



(57) A method of and an arrangement for obtaining 
quality indicators for an objective assessment of a 
degraded or output video signal (11) with respect to a 
reference or input video signal (10). The strength of 
edges or signal transitions (12; 13) in both the input and 
the output video signals (10; 1 1 ) are calculated (1 4) pro- 
viding input and output edge signals (15; 16). By 
processing (19; 21, 22) the edge signals (15; 16) intro- 
duced edges (23) and omitted edges (24) in the output 
edge signal (16) are established. For each of the lumi- 



nance and chrominance signals of a colour video signal 
first and second quality indicators are obtained from 
normalized values of the introduced edges (23) and the 
omitted edges (24). relative to the output edge signal 
(23) and the input edge signal (24) normalized by first 
and second normalization factors, respectively. By 
using smeared Sobel filtering, correlation of calculated 
MOS and observed MOS by human test persons 
reaches a value of above 0.9. 



12 



15 



1 out 



out 



^18 



"X 

(XOU.-X.J ^ 



out " ^ fn ) 



< 

CO 

o> 
o> 

o 

o> 
o 
a. 

LU 



BNSOOCia <EP 0940996A1_L> 



TT 



23^ ^ V~ out ~ * in ) + 



Fig. 4 



Primed by Xerox (UK) Business Services 
2. 16.7/3 6 




EP 0 940 996 A1 

Description 

Field of the Invention 

5 [0001] The present invention relates to video quality and. in particular, to an objective assessment of the quality of 
ceded and transmitted video signals. 

Background of the Invention ,. , 

io [0002] With the development of digital coding technology savings in transmission and/or storage capacity of video 
signals have been achieved and a large number, of new multi-media video services have become available. 
[0003] Savings in transmission and/or storage capacity by digital compression technology generally depend upon the 
amount of information present in the original. video signal, as well as how much quality the user is willing to sacrifice. 
Impairments may result from the coding technology used and limited transmission channel capacity.. 

75 [0004] Video quality assessment can be split into subjective assessment by human observers, providing their subjec- 
tive opinion on the video quality,, and objective assessment which is accomplished by use of electrical measurements. 
[0005] It is the general opinion that assessment of video quality is best established by human observers which is. how- 
ever, a complex, costly and time consuming approach. Accordingly, there is a need to develop objective; visual quality 
measures, based on human perception, that can be used to pr.ecfict the subjective quality of modern yidep services and 

20 applications. \^ . . ... 

[0006] Studies in the framework of the American National Standards institute (ANSI) and the International Telecom-, 
munication Union (ITU) have led to a plurality of algorithms for objective video quality assessment. 
[0007] As will be appreciated by those skilled in the art, calculation, of quality indicators of, video, signals on a pixel . 
bases, for example, requires a large amount of processing. As disclosed in a conference publication by S D. Voran The 

25 development of objective video quality measures that emulate human perception", Globocom'91 oonf. pub!, vol. 3, pp.. 
1776-1781, 1991, an important class of disturbing distortions in a video signal are those that, destroy, soften, blur, dis- 
place, or create edges or signal transitions in the video image. : . . ; . /^'.J* ', ct ' t . 

Summary of the Invention v . ^ ; , , : _ . - •.- ;ti . .^ f ,: , , . . , r . 

30 

[0008] . .The present. inyej^ionrairns. to provide pbjejc^ve:gu^lity measures that.can be used to. assess^he subjective, ,, 
quality of -vtdeo ; signals, dealing: withithe t higher : Jeyels of cpgnftive-prpcessing.wh dominate .the^percep.tipn-.of. video. , 
quality, ,- f . i]: , . ; irVc^ ..T r< S'ft^/: ".i*. iov ' * \k ■' .w/iMi V^V^^" ' 

[0009] • It is a further obj ect of the present invention taprovide such measures, applicable for standardisation, , . l . r . y , 

35 [001 0] It is a still further object of the present i nvention to provide,an. arrangement and equipment for, objective quality, 
assessment of degraded video signals for measuring the quality of video. coding equipment and algorithms, video. trans: 
missions and other multi-media video services. . . lV -. r , , n , T . v .. ... \ , t . 

[0011] These and other objects and features are achieved by the present invention in a method of obtaining quality,, 
indicators for an objective assessment. of a degraded or output video signal with, respect to a reference or. input video 

40 signal by quantifying the strength of edges or signal transitions in both the input and the. output video signals using, edge 
or signal transition detection. The process of .quantifying the strength of.the edges will hereinafter be referenced by ; the 
term edginess. ■ « -, ... ._• ». >._,-. , v , jif 0 , t , • j o: . v ._ , ■> ,-- r -^. ( , . 0 « n 

[001 2] ^ The method. according to the invention comprises the steps of : , rr . ., v - : } n .:„ 

45 a) detect edges in the input and the output video signajs; , ... , - v? ri ...~, 

b) calculate the edginess of the input and the output video, signals, providing input and output edge signals; - 
. c) establish introduced edges in the output edge signal by comparing the input and output edge signals of corre- 
sponding parts of the input and output video signals; ... - , • <- » - j 

d) establish omitted edges in the output edge signal by comparing the input and output edge signals of correspond: 
so ing parts of the input and output video signals; _^ r . : ^ ;:0 j. t; 

e) obtain normalized values of the introduced edges relative to the output edge signal adjusted by a first normali- 
zation factor; f- , ; . ' . . 

f) obtain normalized values of the omitted edges relative to the input edge signal adjusted by a second normaliza- 
tion factor; - , r - - - \ x ^ :1 ...;^ r t , 

55 g) calculate a first quality indicator by averaging the values obtained in step e); and ■ , , tj . * ■ ,.• 
h) calculate a second quality indicator by averaging the values obtained in step f) . • { 

[0013] The method according to the invention is based on human visual perception, wherein spatial distortions like 
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the introduction and omission of edges or signal transitions have a great impact on the subjective quality of the video 
signal. Further, it has been found that the introduction of an edge is more disturbing than the omission of an edge. 
[0014] This has been taken into account in the method according to the invention, by obtaining normalized values of 
the introduced edges and the omitted edges. The introduced edges are normalised with respect to the output edge sig- 
5 nal adjusted by a first weighing or normalization factor an the omitted edges are normalised with respect to the input 
edge signal adjusted by a second weighing or normalization factor. Obtaining normalised values according to the 
present invention is more in line with human perception, which is always relative. 

[001 5] The quality indicators for both the introduced and the omitted edges are subsequentially established by calcu- 
lating mean values of the thus normalised introduced and omitted edges or signal transitions in the output video signal. 
w [001 6] For a number of different types 'of video signals, classified by the amount of motion in the pictures, the quality 
indicators obtained with the invention are close to the quality' indicators obtained from subjective measurements by 
human observers.*'.' ;i ''" • ' ! " • ~ : - .* 

[001 7] In a preferred embodiment of the method according to the invention, the proportions of introduced and omitted 
edges are established from respective polarities of a bipolar distortion signal formed from difference building of aligned, 

15 corresponding unipolar input and output edge signals of corresponding parts of the input and output video signals. *■ 
[001 S) ' The first and second normalization factors may be fixed or, preferably, set in accordance' with the characteris- 
tics of the video signals, such as the luminance and chrominance values thereof. - ' 
[0019] ' For high luminance' Valued, edge deteriorations are i ess visible which, in a further embodiment of the invention, 
is taken into account in that the first normalization factor comprises a variable part obtained from the maximum charac- 

20 teristic values of the video signals, such as the luminance signal. ' 
[0020]'" Calculation of the edginess carl be established in a variety of manners. However, the most straigthforward 
mathematical formulation is to calculate the' norm of the gradient of the video signals. An example hereof is Sobel filter- 
ing which has proven to proyde reliable resurts. Depending on how derivates of the video signals are approximated, 
many variations in the calculation of 'tffe edginess arie feasible. All these types hereinafter will be referred \o as Sobel 

25 filtering. " ; ■ " { 5 • 

[0021] : Iri a preferred y en^b^irTient of the invention, in particular wherein the introduced and omitted edges are 
obtained from a distortion signal formed from aligned input and output edge signals, improved or smeared Sobel filter- 
ing provides excellent results. With smeared Sobel filtering, a smearing operator having a width of, for example. 3 pixels 
is used. By this smearing operation, the effect of misalignment in the formation of the distortion signal is compensated 

30 for. 

[0022]^ AligHfnetft offifie input' and output ed§e signals is reb^ir^Hi>ecause video sequences processed by a codec or 
trarfsTftrr^ channel, 1 for exa 

from picture to picture. If the video sequence contains relative little motion, there is only a little influence on the objective 
video qual ity'if leasure : 'However. wrtK large 'movements the' omissiort of delay compensation leads to a large mismatch 

35 in scene cbnterit between original and distorted sequences" This inadvertently Increases the computed distortions. To 
solve the time varying delay problem; kribwn alignment alcprithms can be used such as disclosed by ITU-T Contribution 
COM-12-29, "Draft new recommendation on multi-media communication delay, synchronizatidnr, and frame rate meas- 
uremeft" r DecH99?: K f' • J 1 ' ■'" " " c~ - 1 ^ ■'■ • ' - * v ' ' : " ' ' '" : ' r 

[0023] '■ In pfafaice, in accordance With the invention, the quality indicators are obtained from the luminance' and 

40 chrominance re"pf esehtations of a colour video sighaJ . : * ' : - : ^ r ? 1 ' 1 . 

[0024] ! HeiirisW optimization has led to quality mdicators obtained from smeared Sobel edge detection wherein for 
the luminance signals the constant part of the first normalization factor is in a range between 1 5 and 30, preferably 20; 
the constant part of the second normalization factor is in a range between 5 and 15, preferably 1 10; arid the variable part 
of the first normalization factor is in a range between 0.3 and 1 , preferably 0.6 times the maximum edge values of the 

45 luminance signal of the input and output video signals. For the chrominance signals, the constant part of the first and 
second weighing factors is in a range between 5 and* 15, preferably 10 .■ • 

[0025} 'From the thus obtained first and second quality indicators of each the luminance' and chrominance signals, 
weighted quality indicators are obtained. For example, using multiple linear regression techniques. For a Mean Opinion 
Score (MDS) calculated from the weighted quality indicators obtained from the above smeared' Sobel filtering and pre- 
so f erred weighing factors, correlation of the calculated MOS and observed MOS from subjective measurements reaches 
a vat ufe of above 0.9' which is required for ma king reliable predictions. 

[0026] The best results are obtained from training the method on subjective reference quality data such that the nor- 
malization factors" and/or weighing of the quality indicators are optimized. * 
[0027] The invention further provides an arrangement for obtaining quality indicators for an objective assessment of 
55 a degraded or output video signal with respect to a reference or input video signal by quantifying the strength of edges 
or signal transitions in both the input and the output video signals using edge or signal transition detection. The arrange- 
ment comprises: 
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a) means tor detecting edges in the input and the output video signals; 

b) means for calculating the edginess of the input and the output video signals, providing input and output edge sig- 
nals; 

c) means for establishing introduced edges in the output edge signal by comparing the input and output edge sig- 
nals of corresponding parts of the input and output video signals; 

d) means for establishing omitted edges in the output edge signal by comparing' the input and output edge signals 
of corresponding parts of the input and output video signals; 1 

e) means for obtaining normalized values of the introduced edges relative to the output edge signal adjusted by a 
first normalization factor; 

f) means for obtaining normalized values of the omitted edges relative to the input edge signal adjusted by a second 
normalization factor; . ' , 

g) means for calculating a first quality indicator by averaging the values obtained in step e); and , ' 

h) means for calculating a second quality indicator by averaging the^ values obtained in step f)- 

[0028] In a preferred embodiment, the edge detection and calculation means comprise improved or smeared Sobel 
filter means. . * \ ' " ~ : 

[0029] Those skilled in the art will appreciate that the means mentioned above under a) and b) can be jDhysicalty com- 
bined or provided by a single means for both the input and 'output video signal using appropriate multiplexing means, 
for example. Likewise, means c) and d). and/or means e) and f), as well as means g) and h) m^y be combined or sep- 
arate. ' ~ . ,. . . . -. . <- "-..'.',.. 

[0030] The arrangement as a whole can be implemented in suitable digital processor rheajps'and incorporated in an 
Application Specific Integrated Circuit (ASIC), for use in measuring the quality of video codecs and the quality of video 
transmissions, for' example. '\ < : *. " * 
[0031] The above and other features and advantages of the present invention i will b« readily apparent io one of ordi- 
nary skill in the art from the following written description when read in conjunction fwrth i the drawings rp Which' like refer- 
ence numerals refer to like elements. * , . '. \"_ , / 

Brief Description of the Drawings " ' /V f ' ' '. . . " " - * - ■ 

[0032] " l 'V 1 * 1 ■ ." V 1 ,"' v '. v ' ** : y] 

Fig.. 1 shows an approach towards objective measurement of the quality of a video system wherein . a percep'- , 

tual/coo^itiye.mc^e^^irnulates ajiurnan subject. .,.„"". „. f „- >r VJ . , 

Rg. 2 shows, in a schematic representation , basic objective measurement' fojlpwlng the approach' shown in fig".* 11"* 
Rg : 3a shows a video type picture and fig. 3b shows edges or signal transitions in the picture.of f ig \ 3a. , 
; Rg. 4 shows, jn a schematic and illustrative manner, aa exemplary embodiment of' establishing irtobduc^ jkrti 
, ' r emitted, edges ih r an,ou^ut video signal. . t , t '/,..'' r . w . , . ; n >; '."\ „" .". ^.v'V r.-- - . 

. Fig. 5 snows a flow chart type diagram 'of the main embodiment of the method according to the irwentibn, " 
' Fig . 6 shows a block diagram of an arrangement according to the present invention^ ^ , ' s ^ \V _ ^ 

Detailed Description of the Embodiments " ' *V' :V , ■ -j "\ r 

[0033] Two main categories of video quality assessment can be distinguished. That is subjective assessment and 
objective assessment. Objective assessment of video quality, such as for television broadcast, in the past has been 
accomplished through resolution charts, colour bars, frequency response measurements, and by measuring the signal 
to noise ratio of the video signal. With the introduction of advanced digital video coding and decoding techniques, clas- 
sical objective quality measurements like signal to noise ratio and total harmonic distortion have been proven less use- 
ful. These classical objective visual quality measurements do not take the user into account who decides by its. own 
subjective assessment whether a video signal meets an expected quality level, the availability of objective test methods 
that show a high correlation with the subjective quality is therefore important. 

[0034] Rg. 1 shows a so-called black box approach towards objective measurement of the quality of a video system 
1 , such as a video codec (coder/decoder), a transmission device or transmission path etc. 

[0035] A video input or reference signal Y jn provided at an input terminal 2 is processed by the video system 1 into 
an output video signal Y out at an output terminal 3. 

[0036] A human subject 4 receiving the output video signal Y out through his eyes, will not perceive any differences 
between the input and output video signals for an ideal video system 1 . However, in practice, -the video system. 1 will 
degrade the output compared to the input, leading to a quality impression by the human subject. The level of the quality 
impression is determined both by the perception of the input and output signals by the human subject, i.e. his visual 
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organs, as well as his cognition, i.e. the manner in which the perceived signals are interpreted by his brains. 

[0037j Accordingly, objective quality assessment of video signals correlating with subjective quality impressions, has 

to be based on both a perceptual and cognitive model 5. 

[0038] Fig. 2 shows the basic principles of objective measurement, wherein a perceptual model 6 transforms the input 
£ and. output video signals into an internal representation of the input and output video signals. The difference 7 in the 
internal representations is mapped at a quality level using a cognitive model 8. Perceptual models 6 are generally based 
on edge.or signal transition, using spatial filters originating from the human visual system. 

[0039] * It is the aim of the present invention to assess the quality perception of a human subject in an as much as 
possible accurate manner from objective measurements. . . 

w [0040] Fig. 3a shows a video type picture,' whereas'fig. 3b shows edges or signal transitions detected in the picture. 
For illustration purposes, an arbitrary corresponding part in both figures is indicated by an ellips 9. 
[0041] The invention. is primarily based on edge or signal transition detection of a video signal as illustrated, by way 
of example, in fig. 4. 

[0042] Signal parts 10 and 1 1 of an input video signal Y jn and an output video signal Y out respectively, are time and 
t5 space aligned In order to rule out inherent time delays or spatial shifts'tn the video system 1 (fig. 1 ). The signal part 10 
comprises an edge or signal transition 12, as shown, while signal part 11 comprises an edge or signal transition 13, 
shifted in position with respect to edge 12 and of a lower amplitude. In the present example, edge 13 is assumed to be 
a new" or introduced [.edge in the output signal Y OLJ t v 1 

[0043] In the ideai undistorted case, both signal parts 1 1 and 12 have edges at the same position and of the same 

20 amplitude, such that they cancel each other in a distortion signal formed by difference building. 

[0044] , The' signal parts lO.and l t are subjected to an ecige operator, indicated by an arrpw'14. for quantifying the 
■ strength of the edges"li2 arid 1 3,' providing edge signals X jn and X^, respectively, referenced by numerals 15 and 16. 
[0045] ^ As shown, the edge signals are of a unipolar nature, i.e. for both the leading and trailing portions of the edges 
12 arid 13 correspondingly posrtiorjed positive pulses 17 and 18 are provided. 

25 [0046] In a nexl step, iribicatedby an arrow 19, a distortion signal 20 is formed by subtraction of the edge signal 15 
from the edge signal 16. i.e. (X out - X jn ). This distortion signal 20 is of a bipolar nature, as shown. 1 From the distortion or 
difference signal 20 introduced and omitted edges are established as indicated by arrows 21 respectively 22. 
[0047] The positive part of the bipolar distortion signal 20, i.e. noted (Xo Ut - X in ) + , provides introduced edges in the 
output signal 1 1 . That is, the edge 13 which is not present in the input signal. The negative portion of the distortion sig- 

30 nal 20, i.e. noted (X^ - X in ), provides the omitted edges in the output signal 1 1 . that is the edge 12 of the input signal 
10 which is not present in the output signal 11. . . . A - 

[00481 Those sktlled'in the art will appreciate that edge detection for the purpose of . the present invention can be 
established by \a differentiation or derivative operation, generating a ; plurality ;'of ecfg% rrjagnituo!e; values based on the 
image vaiue^xe.'fefer^^ '\ J 

35 [Q049] In a^referred embodiment of the iri^erition; the edge detector can be a Sobei operator that generates the mag- 
nitude values frorri the derivative of the image values, i.e: the rate of change 6f intensity oyer a' plurality of image * pixels. 
[0050] Sobel filtering is an operation which is well known in the art of image processing, and can be foundfih many 
text books on this subject; such as "Digital Image Processing", by R.C. Gohzalez and P. Winz 2nd Ed.; Addison-Wesley 
Publishing Co., Reading, Massachusetts. 1987. s 

40 [0051 ] In the classical Sobel filtering, the rate of change of the pixels of a video image along the x-axis, i.e. the hori- 
zontal edges, is determined by convolving the video image with the matrix: ^ - 

■■?"■. nsv. .::L f :i -i ".c v. ' ■ >M ^ - - ' ^ ""■ . . . " ( '"- 

[0052] The rate of change of the pixels of the video image along the y-axis, i.e the vertical edges, is determined by 
convolving the irnage with the matrix: *. 

50 ...... , ... '*.*.',. 

' > .... .. J J v. < ■ ■/ ;2 0 2 

-1 0 1 

£5 ;v, , :: : . , .„.; , ; r . ir - ' l ' : ' . 

[0053] The square root 6f the sum of both edge detectors provides the edge magnitude in a pixel or point of the video 

image. ' ' ^l'"."., V" „'.'" '' I*. *\ . * / '[ ■**.-."'-"'"' 

[0054] The invention makes use of the* irisight that human perception is a relative operation, such that a weighing or 
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normalization of the introduced and omitted edges is established. 

[0055] Accordingly, the introduced edges are normalized relative to the output edge signal adjusted by a first normal- 
ization factor and the omitted edges are normalised relative to the input edge signal adjusted by a second normalization 
factor. This leads to the following equations: 

Q1 - mean (X M iW1 (1) 

o>r> • ^ out " X in) ' /ox 

Q2 = mean X ^ W2 (2) 

wherein: .... . ... 



Q1 = first quality indicator for introduced edges. 
Q2 = second quality indicator for omitted edges. 
W1 = first normalization factor. 
W2 = second normalization factor. 



[0056] The quality factors are separately calculated for the luminance and chrominance parts of colour video signals 
The normalization factors W1 and W2 are set in accordance with the characteristics of the I video signals and may cdrr 
prise a constant part corresponding to luminance and chrominance values of the video signals. 
[0057] In a preferred embodiment of the invention, the first normalization fector ccHTiprises a variable part obtained 
25 from the maximum edge values of the input and output video signals. Preferably, the rr&irirfwrn ^.9^ V alues of the lurrri- . 
nance signal of the input and output video signals. This, because edge deteriorations for high' luminance values are less 
visible. Applying Sobel operation as the edge operator in accordance with the invention, equations (1) and (2) can be 
written as: . . 



30 01 _.._ {^ l ( Y o U ,)-Sobel(Y in )}^ 

= Sobel + (3) 

{Sobel <Y 0 „,) - Sobel (Y,,,)) ' 
Q2 = mean Sobe"(Y „) + W2 W 

wherein: . , ' ' : ' 

40 Sobeipr) is Sobel filtering of the video signal Y. 

[0058] As discussed above, for the purpose of the present invention, the input and output video signals have to be 
time and space aligned. .'„,.-.- 

[0059] In order to correct for misalignments and to adapt the processing with respect to the spatial resolution of the 
45 video signal, the Sobel filter has been enhanced by a so-called Smearing operator, having a width of a few pixels. Use 
of this smearing operator has the effect of extending the Sobel filter operation over the image pixels. 
[0060] A three pixel width smearing of the filtered signal is defined as: . _ 0 . ,,. ;r 



Smeared Sobel (Y) = MAX (i = -1,0,1 j = -1 ,0,1 Sobel u (Y)} . ; c r : -. r , " ' • " (5) 

wherein: . . ; _ . ~ 

i.j = pixels in x and y directions over which the Sobel filtering is extended. c , ^ . ^ v . v 

[0061] Again, for reliable results, first and second quality indicators for introduced and crnitted edges have to be sepj- 

arately calculated for the luminance and chrominance parts of a colour video signal. J " 

[0062] From heuristic optimization, for the luminance signals, reliable results are provided by a first normalization fac- 
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tor W1 in a range between 15 and 30, preferably 20 and comprising a variable part in a range between 0.3 and 1 , pref- 
erably 6.6 times the maximum edge values of the luminance signal, and a second normalization factor in a range 
between 5 and 1 5, preferably 10. For the chrominance signals, the first and second normalization factors are to be cho- 
sen in a range between 5 and 15, preferably 10. 

[0063] Accordingly, for the luminance signals, in a preferred embodiment of the invention excellent quality indicators 
are obtained from: 

{Smeared Sobel ( Y Q L ut ) - Smeared Sobel ( Y^)} + 
Q1(L) = mean ■ r ; — (6) 

Smeared Sobel (Y 0 L ut ) +10 + 0.6 MAX (X in , X^ ut ) 

{Smeared Sobel (Y 0 L ut ) - Smeared Sobel (Y: L n )} " 
Q2(L) = mean 2-2H2£ LiSiL (7) 

Smeared Sobel (Yj L n ) + 10 

wherein: 

Q(L) = quality indicator for luminance signals 

t Y L = luminance signal, _ r , w . . . 
X L = edge luminance signal : \ * " 

[0064] The rational for the factor 0.6 MAX {X , X D u t ) lays in the Weber law, which states that subjects are less sen- 
sitive tc t absolute contrast for large luminance ^lues. 

[0065] ^ For bbth chrpminanpes ^ sigriais C^ ahd C B of the video signals, quality indicators are obtained from: 

{Smeared Sobel (Y 0 C ^ t )- Smeared Sobel (Y^ n R )} + 

Q1(C R ) = 5- (S> 

Smeared Sobel (Y 0 £ t ) + 10 

U ' : ' "YV - ^'ioo " ,w '" ' c 

{Smeared Sobel (Y " ) - Smeared Sobel (Y jn R )} " 
Q2(C R ) a - : m (9) 

- . t Smeared Sobel (Y^) + 10 

{Smeared Sobel (y5*) - Smeared Sobel (Y° B )} + 
Q1(C B )- 5 )_jil!L- (10) 

Smeared Sobel (Y 0 *,) + 10 

{Smeared Sobel (Y?*) - Smeared Sobel (Y^ 6 )) ' 
Smeared Sobel (Y in B ) + 10 

45 "'^ wherein:' ' \ 
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Q(C R ) = quality indicator for chrominance C R : signai. 
Q(Cb) = quality indicator tor chrominance C B signal. 
1 = chrominance Cr signal. 

Y°B = chrominance C B signal. 



[0066] Using multiple linear regression techniques, a Mean Opinion Score (MOS) can be calculated from the six qual- 
ity indicators obtained and three quality indicators derived from the LP -distance between the reference or input video 
signal and the degraded or output video signal! With the present invention, correlation of the calculated MOS and the 
55 observed MOS from subjective measurements of human test persons reaches a value of above 0.9 which is required 
for standardisation purposes within ANSI-ITU. 

[0067] The normalization factors and weighing of the quality indicators can be further optimized from running the 
method according to the invention for subjective quality data for a number of training video sequences, for example. 
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[0068] Figure 5 shows, in a flow chart type diagram, the main steps of the method according to the present invention. 
[0069] Detection of edges and calculation of the edginess of the input video signal are schematically indicated by 
blocks 25 and 26, while blocks 27 and 28 disclose same for the output video signal. 

[0070] From the edge signals obtained in the blocks 26 and 28, introduced and omitted edges in the output signal are 
5 established,, referenced by blocks 29 and 33, respectively. 

[0071] In accordance with human perception, normalised values are obtained, by introducing a first and second nor- 
malization factor as, indicated by blocks 30 and 34, respectively. The introduced edges are normalized with respect to 
the output edge signal, whereas the omitted edges in the output signal are normalized with respect to the input edge 
signal. . . ■. . 

io [0072] Averaging of the values obtained, blocks 31 and 35, leads to the first and second quality indicators according 
to the present invention, referenced by blocks 32 and 35, respectively. 

[0073] . Figure 6 shows a schematic block diagram of an arrangement for obtaining quality indicators for an objective 
assessment of video signal quality in accordance with the method of the invention: , < : , 

[0074] At input terminal 40 an output video signal is provided, time and space aligned with an input video signal 
15 Y jn , provided at input terminal 41. Edge detection and calculation means 42 and 43 are operative to detect edges and 
to quantify the strength of the edges, i.e. the edginess of the respective video signals, providing output and input edge 
signals, respectively. In a preferred embodiment of the invention, the means 42 and 43 are arranged for Sobel filtering 
of the video signals, in particular smeared Sobel filtering. , . , ( . . . > 

[0075] The edge signals provided are fed to means 44 for establishing a distortion signal or difference signal, such as 
20 the distortion signal 20 illustrated in figure 4. 

[0076] . Detection means 45 operate on the distortion signal for detecting introduced, edges in the. output edge signal 
and detection means 46 operate on the distortion signal to detect omitted edges in the output edge signal. 
[0077] From the introduced edges, in combination with a first normalization factor applied at input terminal 47 of aver- 
aging means 49, a first quality indicator 51 is calculated. A second quality indicator §2: is calculated by averaging means 
25 50 from the omitted edge signal in accordance with a second normalization factor applied aj an ipput terminal 48 of the 
averaging means 50. 

[0078] : Those skilled in the art will appreciate that the edge detection and calculation means-42.,-43 can be combined 
into single, edge operator means, while using appropriate multiplexing techniques. This is, also. valid for the detection 
means 45 and, 46, as.well as the averaging means 49 and 50. Preferably, the circuit presented can be implemented in 
30 an ; Application SpeGffic Integrated Circuit (ASIC), or suitable programmed processor means: . ,- : ; ; - / 

[0079] The arrangement can be used for measuring the quality of video transmissions as well as for.rf^surinq.the 
quality of video codecs or any other video processing systems. 

[0080] While. the present inyention.has been described w,ith ; respect to a particular embodiment, those skilled in, the. 
art will recognize that the present invention is not limited .to, the embodiments described and illustrated herein Different 
35 embodiments and adaptions beside those shown and discussed as well as many variations, modifications and equiva- 
lent, arrangements will now be reasonable suggested by. the foregoing specification and drawings without departing 
from the. substance or scope of the invention.. Accordingly, it is intended, that the invention be limited onjy by- the, spirit 
and scope of the claims appendant hereto. * . ,,,, r u , c , 

40 Claims ; . „ , . L . .■ ■ .:. .- • o-i- .„ ., - . ry . r . . n-Jx v. 

1 . A method of obtaining quality indicators for an objective assessment of a degraded or output video signal with 
;respect to a reference or input video signal by quantifying the strength of edges -.or signal transitions, in both the 
input and the output video signals using edge or s|gnal j transition detection, said method comprising the ^steps of: 

45 

a) detect edges in the input and the output video signals; s _ - ;> l? . : .>,- :V .- , 

b) calculate the edginess of the input and the output video signals, providing input and outpul : edge signals; 

c) establish introduced edges in the output edge signal by comparing the input and output edge signals of cor- 
responding parts of - the input and output video signals; 

so d) establish omitted edges in the output edge signal by comparing the input and output-edge signals of corre- 

sponding parts of the input and output video signals; . , £ ; : > 

e) obtain normalized values of the introduced edges relative to the output edge signal adjusted by a first nor- 
malization factor; , . j 

0 obtain normalized values of the omitted . edges relative to Jthe inpiit edge signal adjusted by a second normal- 
55 ization factor; r , ^ . .. ,,: - : 

g) calculate a first quality indicator by averaging.the values obtained in step e); and , . - ;c ; . ? 

h) calculate a second quality indicator by averaging the values obtained in step f) :< ; - , . ; 
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2. A method according to claim 1 ', wherein 

i) the input and output edge signals are provided as corresponding unipolar signals; 

j) the input and output edge signals of corresponding parts of the input and output video signals are aligned; 
k) a bipolar distortion signal is established by difference building of the aligned input and output edge signals, 

I) the introduced and omitted edges are established from the respective polarities of the distortion signal. 

3. A method according to claim 1 or claim 2, wherein the first and second normalization factors are set in accordance 
'with the characteristics of the video signals. 

4. A method according to daim 3, wherein the first and second normalization factors comprise a constant part set in 
accordance with luminance and chrominance values of this video signals: 

51 A method accordingtdclaim 3 or 4, wherein the first normalization factor comprises a variable part obtained from 
'■ maximum characteristic edge values of the video signals. "'■ ' 1 : ■ ' 

6. A method according to any of the previous claims, wherein the input and output edge signals are provided from 
"* Sobel filter \hg. : ^ ' " '' - ' 

7: A method according to diaim 6, wherein thVinput and output edge sigrialsare provided from improved orsmeared 
Sobel filtering-. ''■ 1 c - x "'" rv "-' ' - •■»■-' - . 

8. ! ; A method according to 1 any of the previous claims, 'wherein the first and second quality indicators are obtained for 

either luminance ariti/oif chrbrniriance signals of the input and output video signals. 

9. ; A method a<&6&rhg tadaim 8, dependent on claims 5 and 7, wherein for the luminance signals the coristant'part 
" of the ! first normalization factor is in a range between 15 and 30, preferably 20, the constant part of the second nor- 
malization factor is in a range between 5 and 15, preferably 1 0, and the variable part of the first normalization factor 
is in a range between 0.3 and 1, preferably 0.6, times the maximum' value^'of the luminance signal of the'ihpurand 

^ i1 dutF>ut Video signals. " v ' " ;i ' r - r - '<>■ $>'j ^•■ < '.'.^^\; :r ; re ;r;o: -^.;n^,; ^.-n »■ 

iW'A^ethbii acrortiing to elairfi 9, wherein for the chromihahce signals the'co^stanl part of the first and second hbr- " 
^-^ri^'izatibn^factors'is'in a 'range between 5 Shd 15; preferably 10. j * 4 5 * '> ; > * ; i r 

ii 7 -A' method according to claim -8/9 "or 10/ wherein of the first and second quality indicators of each the luminance and 

■ (^rbminance^signals a weighted quality indicator Is obtained, and a' Mean Opinion Score (MOS) is calculated from" 
the obtained weighted quality indicators. " ! - ' f: " v '* ' ■ • " r " ; 

12. A method according to claim 1 1 , wherein multiple linear regression techniques are used for weighing of the respec- 
tive first and second quality indicators. 

13. A method according to any of the previous daims;' wherein the normalization factors and/or weighing of the quality 
' indicators -are ^et from quality indicators obtained from subjective quality data and calculated quality data. 

14. An arrangement for obtaining quality indicators for aft objective assessment of a degraded or output video signal 
• with respect toaTefererice or input video signal by quantifying the strength of edges or signal transitions in both the 

■ ,; ir?put'and the output video signals using edge or signal transition detection, said arrangement comprising: 

11 ; a) means for detecting edges in the input and the output video signals; r " - - 

b) means for calculating the edginess of the input and the output video signals, providing input and output edge 
signals; '"■ !%; v *'* ** * c " '* ' ■ 

c) means for establishing introduced edges in the output edge signal by comparing the input and output edge 
signals of corresponding parts of the input and output video signals: 

d) means for establishing omitted edges in the output edge signal by comparing the input and output edge sig- 
nals of corresponding parts of the input and output video signals; 

e) means for obtaining normalized values of the introduced edges relative to the output edge signal adjusted 
by a first normalization factor; 



0940996A1 J_> 



EP 0 940 996 A1 

0 means for obtaining normalized values of the omitted edges relative to the input edge signal adjusted by a 
second normalization factor; 

g) means for calculating a first quality indicator by averaging the values obtained in step e); and 

h) means for calculating a second quality indicator by averaging the values obtained in step f). 

5 

15. An arrangement according to claim 14, wherein the edge detection and calculation means comprise Sobel filter 
means. 

16. An arrangement according to claim 14, wherein the edge detection and calculation means comprise improved or 
io smeared Sobel filter means. < 

f ■ 

17. An arrangement according to claim 14; 15 or 16, implemented in digital processor means. 

18. An Application Specific Integrated Circuit (ASIC) adapted to/operate in accordance with any of the previous claims. 

19. Use of the method, arrangement and/on ASIC according to any of the^previous claims, in measuring;the quality of 
video codecs. 

20. Use of the method, arrangement and/qr ASIC according to any of the claims 1 to 18, in measuring;the quality of 
20 video transmissions. 
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